Systems and methods for adjusting activity control parameters

ABSTRACT

Systems and methods for generating sounds in a vehicle or other location are presented. In one example, a single user input may be a basis for adjusting a sound level and a frequency of occurrence of a sound that is stored in controller memory and that is output via one or more speakers.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application claims priority to U.S. Provisional ApplicationNo. 62/954,195, entitled “SYSTEMS AND METHODS FOR ADJUSTING ACTIVITYCONTROL PARAMETERS”, and filed on Dec. 27, 2019. The entire contents ofthe above-listed application are hereby incorporated by reference forall purposes.

BACKGROUND

The disclosure relates to sounds, which may be output in a vehicle.

SUMMARY

Some infotainment systems include prerecorded sounds from actual naturalsettings or artificially generated sounds that may be played back in theform of audio sounds to human users. For example, infotainment systemusers may hear only one sound from a group of sounds. The group ofsounds may include the sound of rain falling, waterfalls, ocean waves,or thunder, for example. The user may select the sound to be played backand the sound may be played back over speakers in a vehicle so that thehuman users may experience a sensation, such as being relaxed or calm.Hearing the sounds may also reduce stress and anxiety for human users.The infotainment system may also display scenes that correspond to thesounds being played so as to further enhance the user experience.Although, the sounds and scenes may succeed in setting a mood orenvironment for users, the sounds and scenes may be static andinflexible. In particular, the volume or sound power level may be theonly aspect of prerecorded or artificially generated sounds that may beadjusted. Consequently, users may show less interest in the prerecordedsounds once they become accustomed to hearing the sounds. In addition,each prerecorded or artificially generated sound may be useful for onlysetting conditions to bring about only one user mood or psychologicalstate of mind.

The inventors have recognized the previously mentioned issues and havedeveloped systems and methods to at least partially address the aboveissues. In particular, the inventors have developed a method forgenerating sounds in a vehicle, comprising: generating sounds accordingto a state of a user control that includes an operating range that issubdivided into a plurality of group regions, each of the plurality ofgroup regions associated with one or more elements unique to a groupregion within the plurality of group regions.

By generating sounds according to a position of a user control thatincludes an operating range that is subdivided into a plurality of groupregions, it may be possible to combine two or more sounds to increasethe diversity of sound generated via an infotainment center. Further, abase sound may be augmented with additional sounds, modified infrequency of repetition, and adjusted in sound output power level so asto provide a range of mood changing or enhancing sounds. Consequently,functionality of an infotainment system or audio system may be improvedwhile ease of system control may be provided via a position of a soleuser control.

The present description may provide several advantages. Specifically,the approach may increase diversity of mood changing sounds that may beavailable to system users. In addition, the approach may provideincreased functionality via a simple single user input. Further, theapproach allows a user to change an intensity level of an experience viathe same single input.

The above advantages and other advantages, and features of the presentdescription will be readily apparent from the following DetailedDescription when taken alone or in connection with the accompanyingdrawings.

It should be understood that the summary above is provided to introducein simplified form a selection of concepts that are further described inthe detailed description. It is not meant to identify key or essentialfeatures of the claimed subject matter, the scope of which is defineduniquely by the claims that follow the detailed description.Furthermore, the claimed subject matter is not limited toimplementations that solve any disadvantages noted above or in any partof this disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an example partial view of a vehicle cabin in accordancewith one or more embodiments of the present disclosure;

FIG. 2 shows an example in-vehicle computing system in accordance withone or more embodiments of the present disclosure;

FIG. 3 shows an example sound processing system in a vehicle inaccordance with one or more embodiments of the present disclosure;

FIG. 4A shows a schematic depiction of an example activity control;

FIG. 4B shows a schematic depiction of an activity control with examplecontrol regions;

FIG. 4C shows a schematic depiction of two activity controls withexample control regions;

FIG. 5 shows plots of audio attributes that may be modified according toa state of the user interface shown in FIG. 4;

FIG. 6 shows a flow chart of an example method for generating sound viaan audio or infotainment system; and

FIG. 7 shows example scene and sounds associated with the scenes.

DETAILED DESCRIPTION

The present disclosure relates to generating sounds according to userinput. The generating of sound includes generating sounds in a firstgroup of sounds according to a position or state of a user input andadding additional sounds to the first group of sounds as a position orstate of the user input is changed. Further, the user input may controla volume or sound output power level (e.g., decibels (dB)) and afrequency at which activated sounds are repeated when the sounds arebeing generated.

As shown in FIGS. 1-3, a system according to the present disclosure maybe part of a vehicle, and methods according to the present disclosuremay be carried out via an in-vehicle computing system.

FIG. 1 shows an example partial view of one type of environment for anaudio customization system: an interior of a cabin 100 of a vehicle 102,in which a driver and/or one or more passengers may be seated. Vehicle102 of FIG. 1 may be a motor vehicle including drive wheels (not shown)and an internal combustion engine 104. Internal combustion engine 104may include one or more combustion chambers which may receive intake airvia an intake passage and exhaust combustion gases via an exhaustpassage. Vehicle 102 may be a road automobile, among other types ofvehicles. In some examples, vehicle 102 may include a hybrid propulsionsystem including an energy conversion device operable to absorb energyfrom vehicle motion and/or the engine and convert the absorbed energy toan energy form suitable for storage by an energy storage device. Vehicle102 may include a fully electric vehicle, incorporating fuel cells,solar energy capturing elements, and/or other energy storage systems forpowering the vehicle.

As shown, an instrument panel 106 may include various displays andcontrols accessible to a human driver (also referred to as the user) ofvehicle 102. For example, instrument panel 106 may include a touchscreen 108 of an in-vehicle computing system 109 (e.g., an infotainmentsystem), an audio system control panel, and an instrument cluster 110.Touch screen 108 may receive user input to the in-vehicle computingsystem 109 for controlling audio output, visual display output, userpreferences, control parameter selection, etc. While the example systemshown in FIG. 1 includes audio system controls that may be performed viaa user interface of in-vehicle computing system 109, such as touchscreen 108 without a separate audio system control panel, in otherembodiments, the vehicle may include an audio system control panel,which may include controls for a conventional vehicle audio system suchas a radio, compact disc player, MP3 player, etc. The audio systemcontrols may include features for controlling one or more aspects ofaudio output via speakers 112 of a vehicle speaker system. For example,the in-vehicle computing system or the audio system controls may controla volume of audio output, a distribution of sound among the individualspeakers of the vehicle speaker system, an equalization of audiosignals, and/or any other aspect of the audio output. In furtherexamples, in-vehicle computing system 109 may adjust a radio stationselection, a playlist selection, a source of audio input (e.g., fromradio or CD or MP3), etc., based on user input received directly viatouch screen 108, or based on data regarding the user (such as aphysical state and/or environment of the user) received via externaldevices 150 and/or mobile device 128. The audio system of the vehiclemay include an amplifier (not shown) coupled to plurality ofloudspeakers (not shown). In some embodiments, one or more hardwareelements of in-vehicle computing system 109, such as touch screen 108, adisplay screen 111, various control dials, knobs and buttons, memory,processor(s), and any interface elements (e.g., connectors or ports) mayform an integrated head unit that is installed in instrument panel 106of the vehicle. The head unit may be fixedly or removably attached ininstrument panel 106. In additional or alternative embodiments, one ormore hardware elements of the in-vehicle computing system 109 may bemodular and may be installed in multiple locations of the vehicle.

The cabin 100 may include one or more sensors for monitoring thevehicle, the user, and/or the environment. For example, the cabin 100may include one or more seat-mounted pressure sensors configured tomeasure the pressure applied to the seat to determine the presence of auser, door sensors configured to monitor door activity, humidity sensorsto measure the humidity content of the cabin, microphones to receiveuser input in the form of voice commands, to enable a user to conducttelephone calls, and/or to measure ambient noise in the cabin 100, etc.It is to be understood that the above-described sensors and/or one ormore additional or alternative sensors may be positioned in any suitablelocation of the vehicle. For example, sensors may be positioned in anengine compartment, on an external surface of the vehicle, and/or inother suitable locations for providing information regarding theoperation of the vehicle, ambient conditions of the vehicle, a user ofthe vehicle, etc. Information regarding ambient conditions of thevehicle, vehicle status, or vehicle driver may also be received fromsensors external to/separate from the vehicle (that is, not part of thevehicle system), such as sensors coupled to external devices 150 and/ormobile device 128.

Cabin 100 may also include one or more user objects, such as mobiledevice 128, that are stored in the vehicle before, during, and/or aftertravelling. The mobile device 128 may include a smart phone, a tablet, alaptop computer, a portable media player, and/or any suitable mobilecomputing device. The mobile device 128 may be connected to thein-vehicle computing system via communication link 130. Thecommunication link 130 may be wired (e.g., via Universal Serial Bus[USB], Mobile High-Definition Link [MHL], High-Definition MultimediaInterface [HDMI], Ethernet, etc.) or wireless (e.g., via BLUETOOTH,WIFI, WIFI direct, Near-Field Communication [NFC], cellularconnectivity, etc.) and configured to provide two-way communicationbetween the mobile device and the in-vehicle computing system. Themobile device 128 may include one or more wireless communicationinterfaces for connecting to one or more communication links (e.g., oneor more of the example communication links described above). Thewireless communication interface may include one or more physicaldevices, such as antenna(s) or port(s) coupled to data lines forcarrying transmitted or received data, as well as one or moremodules/drivers for operating the physical devices in accordance withother devices in the mobile device. For example, the communication link130 may provide sensor and/or control signals from various vehiclesystems (such as vehicle audio system, climate control system, etc.) andthe touch screen 108 to the mobile device 128 and may provide controland/or display signals from the mobile device 128 to the in-vehiclesystems and the touch screen 108. The communication link 130 may alsoprovide power to the mobile device 128 from an in-vehicle power sourcein order to charge an internal battery of the mobile device.

In-vehicle computing system 109 may also be communicatively coupled toadditional devices operated and/or accessed by the user but locatedexternal to vehicle 102, such as one or more external devices 150. Inthe depicted embodiment, external devices are located outside of vehicle102 though it will be appreciated that in alternate embodiments,external devices may be located inside cabin 100. The external devicesmay include a server computing system, personal computing system,portable electronic device, electronic wrist band, electronic head band,portable music player, electronic activity tracking device, pedometer,smart-watch, GPS system, etc. External devices 150 may be connected tothe in-vehicle computing system via communication link 136 which may bewired or wireless, as discussed with reference to communication link130, and configured to provide two-way communication between theexternal devices and the in-vehicle computing system. For example,external devices 150 may include one or more sensors and communicationlink 136 may transmit sensor output from external devices 150 toin-vehicle computing system 109 and touch screen 108. External devices150 may also store and/or receive information regarding contextual data,user behavior/preferences, operating rules, etc. and may transmit suchinformation from the external devices 150 to in-vehicle computing system109 and touch screen 108.

In-vehicle computing system 109 may analyze the input received fromexternal devices 150, mobile device 128, and/or other input sources andselect settings for various in-vehicle systems (such as climate controlsystem or audio system), provide output via touch screen 108 and/orspeakers 112, communicate with mobile device 128 and/or external devices150, and/or perform other actions based on the assessment. In someembodiments, all or a portion of the assessment may be performed by themobile device 128 and/or the external devices 150.

In some embodiments, one or more of the external devices 150 may becommunicatively coupled to in-vehicle computing system 109 indirectly,via mobile device 128 and/or another of the external devices 150. Forexample, communication link 136 may communicatively couple externaldevices 150 to mobile device 128 such that output from external devices150 is relayed to mobile device 128. Data received from external devices150 may then be aggregated at mobile device 128 with data collected bymobile device 128, the aggregated data then transmitted to in-vehiclecomputing system 109 and touch screen 108 via communication link 130.Similar data aggregation may occur at a server system and thentransmitted to in-vehicle computing system 109 and touch screen 108 viacommunication link 136/130.

FIG. 2 shows a block diagram of an in-vehicle computing system 109configured and/or integrated inside vehicle 102. In-vehicle computingsystem 109 may perform one or more of the methods described herein insome embodiments. In some examples, the in-vehicle computing system 109may be a vehicle infotainment system configured to provideinformation-based media content (audio and/or visual media content,including entertainment content, navigational services, etc.) to avehicle user to enhance the operator's in-vehicle experience. Thevehicle infotainment system may include, or be coupled to, variousvehicle systems, sub-systems, hardware components, as well as softwareapplications and systems that are integrated in, or integratable into,vehicle 102 in order to enhance an in-vehicle experience for a driverand/or a passenger.

In-vehicle computing system 109 may include one or more processorsincluding an operating system processor 214 and an interface processor220. Operating system processor 214 may execute an operating system onthe in-vehicle computing system, and control input/output, display,playback, and other operations of the in-vehicle computing system.Interface processor 220 may interface with a vehicle control system 230via an inter-vehicle system communication module 222.

Inter-vehicle system communication module 222 may output data to othervehicle systems 231 and vehicle control elements 261, while alsoreceiving data input from other vehicle components and systems 231, 261,e.g. by way of vehicle control system 230. When outputting data,inter-vehicle system communication module 222 may provide a signal via abus corresponding to any status of the vehicle, the vehiclesurroundings, or the output of any other information source connected tothe vehicle. Vehicle data outputs may include, for example, analogsignals (such as current velocity), digital signals provided byindividual information sources (such as clocks, thermometers, locationsensors such as Global Positioning System [GPS] sensors, etc.), digitalsignals propagated through vehicle data networks (such as an engine CANbus through which engine related information may be communicated, aclimate control CAN bus through which climate control relatedinformation may be communicated, and a multimedia data network throughwhich multimedia data is communicated between multimedia components inthe vehicle). For example, the in-vehicle computing system 109 mayretrieve from the engine CAN bus the current speed of the vehicleestimated by the wheel sensors, a power state of the vehicle via abattery and/or power distribution system of the vehicle, an ignitionstate of the vehicle, etc. In addition, other interfacing means such asEthernet may be used as well without departing from the scope of thisdisclosure.

A non-volatile storage device 208 may be included in in-vehiclecomputing system 109 to store data such as instructions executable byprocessors 214 and 220 in non-volatile form. The storage device 208 maystore application data, including prerecorded sounds, to enable thein-vehicle computing system 109 to run an application for connecting toa cloud-based server and/or collecting information for transmission tothe cloud-based server. The application may retrieve informationgathered by vehicle systems/sensors, input devices (e.g., user interface218), data stored in volatile 219A or non-volatile storage device (e.g.,memory) 219B, devices in communication with the in-vehicle computingsystem (e.g., a mobile device connected via a Bluetooth link), etc.In-vehicle computing system 109 may further include a volatile memory219A. Volatile memory 219A may be random access memory (RAM).Non-transitory storage devices, such as non-volatile storage device 208and/or non-volatile memory 219B, may store instructions and/or codethat, when executed by a processor (e.g., operating system processor 214and/or interface processor 220), controls the in-vehicle computingsystem 109 to perform one or more of the actions described in thedisclosure.

A microphone 202 may be included in the in-vehicle computing system 109to receive voice commands from a user, to measure ambient noise in thevehicle, to determine whether audio from speakers of the vehicle istuned in accordance with an acoustic environment of the vehicle, etc. Aspeech processing unit 204 may process voice commands, such as the voicecommands received from the microphone 202. In some embodiments,in-vehicle computing system 109 may also be able to receive voicecommands and sample ambient vehicle noise using a microphone included inan audio system 232 of the vehicle.

One or more additional sensors may be included in a sensor subsystem 210of the in-vehicle computing system 109. For example, the sensorsubsystem 210 may include a camera, such as a rear view camera forassisting a user in parking the vehicle and/or a cabin camera foridentifying a user (e.g., using facial recognition and/or usergestures). Sensor subsystem 210 of in-vehicle computing system 109 maycommunicate with and receive inputs from various vehicle sensors and mayfurther receive user inputs. For example, the inputs received by sensorsubsystem 210 may include transmission gear position, transmissionclutch position, gas pedal input, brake input, transmission selectorposition, vehicle speed, engine speed, mass airflow through the engine,ambient temperature, intake air temperature, etc., as well as inputsfrom climate control system sensors (such as heat transfer fluidtemperature, antifreeze temperature, fan speed, passenger compartmenttemperature, desired passenger compartment temperature, ambienthumidity, etc.), an audio sensor detecting voice commands issued by auser, a fob sensor receiving commands from and optionally tracking thegeographic location/proximity of a fob of the vehicle, etc. Whilecertain vehicle system sensors may communicate with sensor subsystem 210alone, other sensors may communicate with both sensor subsystem 210 andvehicle control system 230, or may communicate with sensor subsystem 210indirectly via vehicle control system 230. A navigation subsystem 211 ofin-vehicle computing system 109 may generate and/or receive navigationinformation such as location information (e.g., via a GPS sensor and/orother sensors from sensor subsystem 210), route guidance, trafficinformation, point-of-interest (POI) identification, and/or provideother navigational services for the driver.

External device interface 212 of in-vehicle computing system 109 may becoupleable to and/or communicate with one or more external devices 150located external to vehicle 102. While the external devices areillustrated as being located external to vehicle 102, it is to beunderstood that they may be temporarily housed in vehicle 102, such aswhen the user is operating the external devices while operating vehicle102. In other words, the external devices 150 are not integral tovehicle 102. The external devices 150 may include a mobile device 128(e.g., connected via a Bluetooth, NFC, WIFI direct, or other wirelessconnection) or an alternate Bluetooth-enabled device 252. Mobile device128 may be a mobile phone, smart phone, wearable devices/sensors thatmay communicate with the in-vehicle computing system via wired and/orwireless communication, or other portable electronic device(s). Otherexternal devices include external services 246. For example, theexternal devices may include extra-vehicular devices that are separatefrom and located externally to the vehicle. Still other external devicesinclude external storage devices 254, such as solid-state drives, pendrives, USB drives, etc. External devices 150 may communicate within-vehicle computing system 109 either wirelessly or via connectorswithout departing from the scope of this disclosure. For example,external devices 150 may communicate with in-vehicle computing system109 through the external device interface 212 over network 260, auniversal serial bus (USB) connection, a direct wired connection, adirect wireless connection, and/or other communication link.

The external device interface 212 may provide a communication interfaceto enable the in-vehicle computing system to communicate with mobiledevices associated with contacts of the driver. For example, theexternal device interface 212 may enable phone calls to be establishedand/or text messages (e.g., SMS, MMS, etc.) to be sent (e.g., via acellular communications network) to a mobile device associated with acontact of the driver. The external device interface 212 mayadditionally or alternatively provide a wireless communication interfaceto enable the in-vehicle computing system to synchronize data with oneor more devices in the vehicle (e.g., the driver's mobile device) viaWIFI direct, as described in more detail below.

One or more applications 244 may be operable on mobile device 128. As anexample, mobile device application 244 may be operated to aggregate userdata regarding interactions of the user with the mobile device. Forexample, mobile device application 244 may aggregate data regardingmusic playlists listened to by the user on the mobile device, telephonecall logs (including a frequency and duration of telephone callsaccepted by the user), positional information including locationsfrequented by the user and an amount of time spent at each location,etc. The collected data may be transferred by application 244 toexternal device interface 212 over network 260. In addition, specificuser data requests may be received at mobile device 128 from in-vehiclecomputing system 109 via the external device interface 212. The specificdata requests may include requests for determining where the user isgeographically located, an ambient noise level and/or music genre at theuser's location, an ambient weather condition (temperature, humidity,etc.) at the user's location, etc. Mobile device application 244 maysend control instructions to components (e.g., microphone, amplifieretc.) or other applications (e.g., navigational applications) of mobiledevice 128 to enable the requested data to be collected on the mobiledevice or requested adjustment made to the components. Mobile deviceapplication 244 may then relay the collected information back toin-vehicle computing system 109.

Likewise, one or more applications 248 may be operable on externalservices 246. As an example, external services applications 248 may beoperated to aggregate and/or analyze data from multiple data sources.For example, external services applications 248 may aggregate data fromone or more social media accounts of the user, data from the in-vehiclecomputing system (e.g., sensor data, log files, user input, etc.), datafrom an internet query (e.g., weather data, POI data), etc. Thecollected data may be transmitted to another device and/or analyzed bythe application to determine a context of the driver, vehicle, andenvironment and perform an action based on the context (e.g.,requesting/sending data to other devices).

Vehicle control system 230 may include controls for controlling aspectsof various vehicle systems 231 involved in different in-vehiclefunctions. These may include, for example, controlling aspects ofvehicle audio system 232 for providing audio entertainment to thevehicle occupants, aspects of climate control system 234 for meeting thecabin cooling or heating needs of the vehicle occupants, as well asaspects of telecommunication system 236 for enabling vehicle occupantsto establish telecommunication linkage with others.

Audio system 232 may include one or more acoustic reproduction devicesincluding electromagnetic transducers such as speakers 235. Vehicleaudio system 232 may be passive or active such as by including a poweramplifier. In some examples, in-vehicle computing system 109 may be theonly audio source for the acoustic reproduction device or there may beother audio sources that are connected to the audio reproduction system(e.g., external devices such as a mobile phone). The connection of anysuch external devices to the audio reproduction device may be analog,digital, or any combination of analog and digital technologies.

Climate control system 234 may be configured to provide a comfortableenvironment within the cabin or passenger compartment of vehicle 102.Climate control system 234 includes components enabling controlledventilation such as air vents, a heater, an air conditioner, anintegrated heater and air-conditioner system, etc. Other componentslinked to the heating and air-conditioning setup may include awindshield defrosting and defogging system capable of clearing thewindshield and a ventilation-air filter for cleaning outside air thatenters the passenger compartment through a fresh-air inlet.

Vehicle control system 230 may also include controls for adjusting thesettings of various vehicle controls 261 (or vehicle system controlelements) related to the engine and/or auxiliary elements within a cabinof the vehicle, such as steering wheel controls 262 (e.g., steeringwheel-mounted audio system controls, cruise controls, windshield wipercontrols, headlight controls, turn signal controls, etc.), instrumentpanel controls, microphone(s), accelerator/brake/clutch pedals, a gearshift, door/window controls positioned in a driver or passenger door,seat controls, cabin light controls, audio system controls, cabintemperature controls, etc. Vehicle controls 261 may also includeinternal engine and vehicle operation controls (e.g., engine controllermodule, actuators, valves, etc.) that are configured to receiveinstructions via the CAN bus of the vehicle to change operation of oneor more of the engine, exhaust system, transmission, and/or othervehicle system. The control signals may also control audio output at oneor more speakers 235 of the vehicle's audio system 232. For example, thecontrol signals may adjust audio output characteristics such as volume,equalization, audio image (e.g., the configuration of the audio signalsto produce audio output that appears to a user to originate from one ormore defined locations), audio distribution among a plurality ofspeakers, etc. Likewise, the control signals may control vents, airconditioner, and/or heater of climate control system 234. For example,the control signals may increase delivery of cooled air to a specificsection of the cabin.

Control elements positioned on an outside of a vehicle (e.g., controlsfor a security system) may also be connected to computing system 109,such as via communication module 222. The control elements of thevehicle control system may be physically and permanently positioned onand/or in the vehicle for receiving user input. In addition to receivingcontrol instructions from in-vehicle computing system 109, vehiclecontrol system 230 may also receive input from one or more externaldevices 150 operated by the user, such as from mobile device 128. Thisallows aspects of vehicle systems 231 and vehicle controls 261 to becontrolled based on user input received from the external devices 150.

In-vehicle computing system 109 may further include an antenna 206.Antenna 206 is shown as a single antenna, but may comprise one or moreantennas in some embodiments. The in-vehicle computing system may obtainbroadband wireless internet access via antenna 206, and may furtherreceive broadcast signals such as radio, television, weather, traffic,and the like. The in-vehicle computing system may receive positioningsignals such as GPS signals via one or more antennas 206. The in-vehiclecomputing system may also receive wireless commands via FR such as viaantenna(s) 206 or via infrared or other means through appropriatereceiving devices. In some embodiments, antenna 206 may be included aspart of audio system 232 or telecommunication system 236. Additionally,antenna 206 may provide AM/FM radio signals to external devices 150(such as to mobile device 128) via external device interface 212.

One or more elements of the in-vehicle computing system 109 may becontrolled by a user via user interface 218. User interface 218 mayinclude a graphical user interface presented on a touch screen, such astouch screen 108 of FIG. 1, and/or user-actuated buttons, switches,knobs, dials, sliders, etc. For example, user-actuated elements mayinclude steering wheel controls, door and/or window controls, instrumentpanel controls, audio system settings, climate control system settings,and the like. A user may also interact with one or more applications ofthe in-vehicle computing system 109 and mobile device 128 via userinterface 218. In addition to receiving a user's vehicle settingpreferences on user interface 218, vehicle settings selected byin-vehicle control system may be displayed to a user on user interface218. Notifications and other messages (e.g., received messages), as wellas navigational assistance, may be displayed to the user on a display ofthe user interface. User preferences/information and/or responses topresented messages may be performed via user input to the userinterface.

FIG. 3 is a block diagram of a vehicle 102 that includes an exampleaudio or sound processing system (AS) 302, which may include any or acombination of the sound processing systems and methods described below.The vehicle 102 includes doors 304, a driver seat 309, a passenger seat310, and a rear seat 312. While a four-door vehicle is shown includingdoors 304-1, 304-2, 304-3, and 304-4, the audio system (AS) 102 may beused in vehicles having more or fewer doors. The vehicle 102 may be anautomobile, truck, boat, or the like. Although only one rear seat isshown, larger vehicles may have multiple rows of rear seats. Smallervehicles may have only one or more seats. While a particular exampleconfiguration is shown, other configurations may be used including thosewith fewer or additional components.

The audio system 302 (which may include an amplifier and/or other audioprocessing device for receiving, processing, and/or outputting audio toone or more speakers of the vehicle) may improve the spatialcharacteristics of surround sound systems. The audio system 302 supportsthe use of a variety of audio components such as radios, COs, DVDs,their derivatives, and the like. The audio system 302 may use 2-channelsource material such as direct left and right, 5.1 channel, 6.2 channel,7 channel, 12 channel and/or any other source materials from a matrixdecoder digitally encoded/decoded discrete source material, and thelike. The audio system 302 utilizes a channel that is only for TI/HWLsounds and is separate from a channel/s for remaining sounds, includingone or more of remaining warning, media, navigational, andtelephone/telematics sounds.

The amplitude and phase characteristics of the source material and thereproduction of specific sound field characteristics in the listeningenvironment both play a key role in the successful reproduction of asurround sound field.

The audio system 302 may improve the reproduction of a surround soundfield by controlling the sound delay time, surround upmixer parameters(e.g., wrap, reverb room size, etc.), amplitude, phase, and mixing ratiobetween discrete and passive decoder surround signals and/or the directtwo-channel output signals, in at least one example. The amplitude,phase, and mixing ratios may be controlled between the discrete andpassive decoder output signals. The spatial sound field reproduction maybe improved for all seating locations by re-orientation of the direct,passive, and active mixing and steering parameters, especially in avehicle environment.

The mixing and steering ratios as well as spectral characteristics maybe adaptively modified as a function of the noise and otherenvironmental factors. In a vehicle, information from the data bus,microphones, and other transduction devices may be used to control themixing and steering parameters.

The vehicle 102 has a front center speaker (CTR speaker) 324, a frontleft speaker (FL speaker) 313, a front right speaker (FR speaker) 315,and at least one pair of surround speakers.

The surround speakers may be a left side speaker (LS speaker) 317 and aright side speaker (RS speaker) 319, a left rear speaker (LR speaker)329 and a right rear speaker (RR speaker) 330, or a combination ofspeaker sets. Other speaker sets may be used. While not shown, one ormore dedicated subwoofers or other drivers may be present. Possiblesubwoofer mounting locations include the trunk 305, below a seat, or therear shelf 308. The vehicle 102 may also have one or more microphones350 mounted in the interior.

Each CTR speaker, FL speaker, FR speaker, LS speaker, RS speaker, LRspeaker, and RR speaker may include one or more transducers of apredetermined range of frequency response such as a tweeter, amid-range, or a woofer. The tweeter, mid-range, or woofer may be mountedadjacent to each other in essentially the same location or in differentlocations. For example, the FL speaker 313 may be a tweeter located indoor 304-1 or elsewhere at a height roughly equivalent to a side mirroror higher. The FR speaker 315 may have a similar arrangement to FLspeaker 313 on the right side of the vehicle (e.g., in door 304-2).

The LR speaker 329 and the RR speaker 330 may each be a woofer mountedin the rear shelf 308. The CTR speaker 324 may be mounted in the frontdashboard 307, in the roof, on or near the rear-view mirror, orelsewhere in the vehicle 102. In other examples, other configurations ofloudspeakers with other frequency response ranges are possible. In someembodiments, additional speakers may be added to an upper pillar in thevehicle to enhance the height of the sound image. For example, an upperpillar may include a vertical or near-vertical support of a car's windowarea. In some examples, the additional speakers may be added to an upperregion of an “A” pillar toward a front of the vehicle.

Turning now to FIG. 4A, one example of an activity control 400 is shown.The activity control 400 may be displayed on a touch screen (e.g., 108of FIG. 1) or mobile device 128. Alternatively, activity control 400 maybe realized as a three dimensional device that is part of audio system232 of FIG. 2. In this example, activity control 400 takes a form of aslider control that includes a slider bar 402 and a slide bar guide 422.However, in other examples, activity control 400 may be realized in theform of a rotary knob or other known user input device without departingfrom the scope or intent of the present description. A position or stateof activity control 400 may refer to a position or state of slider bar402.

Slider bar 402 may be moved longitudinally along the length of slide barguide 422 as indicated by arrows 404 by human user 403. Slider bar 402may be moved to a left extent 420 or a right extent 424 to adjust soundactivity that may be associated with a particular scene that may beshown via display 111 of FIG. 1. For example, a user may wish to relaxby listening to prerecorded sounds of rain falling, waves crashing on aseashore, or water rushing down a creek. The user may select which soundto play back over vehicle speakers and a visual representation of thesound may be displayed on a display panel. Attributes of the sound thatis selected for playback over vehicle speakers may be adjusted accordingto a position of slider bar 402, or of an operating state of theactivity control, as described in further detail in the descriptions ofFIGS. 4B-6.

Slider bar 402 may be in a base position when it is moved left to extent420. Slider bar 402 may be fully advanced when it is moved right toextent 424. In one example, lowest level outputs of controlled sounds orfeatures may be output when slider bar 402 is positioned at the leftextent 420. Greatest or highest level outputs of controlled sounds orfeatures may be output when slider bar 402 is positioned at the rightextent 424.

Referring now to FIG. 4B, an activity control 400 that includes aplurality of control regions is shown. In this example, activity control400 includes three control regions; however, in other examples, theactual total number of control regions may be greater than three or lessthan three. Further, in this example, the control regions each compriseabout one third of the length of slide bar guide 422, but the controlregions may be adjusted according to other dimensions, if desired. Thecontrol range or range of authority of activity control 400 is indicatedby arrow 425 and it spans the three control regions.

A first control region 490 for slide bar 402 begins at a left extent 420of slide bar guide 422 and it ends at vertical line 430. Leader 410shows the range of first control region 490. Slide bar 402 is shown inthe first control region 490, so the computing system 109 shown in FIG.1 or audio system 232 shown in FIG. 2 may play back sounds digitallystored in non-volatile memory that are included in a first group ofsounds that are associated with a particular theme, scene, or scenescapethat has been selected by a user. A theme may be a mood or state of mindthat is being conveyed (e.g., relax, high emotional energy, be happy,etc.). The sounds may be played back or broadcast through the vehicle'sspeakers. The first group of sounds may be characterized as steady-statesounds. Steady-state sounds may include but are not limited to the soundof falling rain drops, the sound of waves crashing on a seashore, thesound of crickets softly chirping, the sound of a soft breeze, and othersounds intended to capture the essence of a mode or the selected theme,scene, or scenescape. Steady-state sounds may be perceived by users asbeing continuous.

The position of slide bar 402 within the first control region 490 maydefine the volume or sound power output level of the speakers and thefrequency of playback or density for the steady-state sounds that areincluded in the selected scene or scenescape. For example, if the slidebar is positioned at the left extent of slide bar guide 422, thensteady-state sounds in the selected theme, scene, or scenescape may beplayed back at a low frequency of repetition (e.g., a rain falling soundsequence retrieved from memory may repeat at a rate of 0.03 Hz) and avery low volume or sound power output level. If the slide bar 402 ismoved to the right and stopped before the slide bar enters the secondcontrol region 491, then the same steady-state sounds may be played backat a higher frequency (e.g., 0.1 Hz) and a low volume or sound powerlevel. Thus, as slide bar 402 is moved from left to right while in thefirst control region, the amount of sound power and frequency ofplayback of steady-state sounds is increased.

A second control region 491 for slide bar 402 begins at the verticalline 430 and it ends at vertical line 432. Leader 412 shows the range ofsecond control region 491. In one example, when slide bar 402 enters thesecond control region 491, the volume or sound power output ofsteady-state sounds is maintained at its most recent level and thestead-state sounds frequency of playback is maintained at its mostrecent level. The computing system 109 shown in FIG. 1 or audio system232 shown in FIG. 2 may begin to play back sounds stored in non-volatilememory that are included in a second group of sounds that are associatedwith the selected particular theme, scene, or scenescape. The sounds maybe played back or broadcast through the vehicle's speakers. The secondgroup of sounds may be characterized as dynamic sounds. Dynamic soundsmay include but are not limited to the sound birds calling, the sound ofdistant thunder, the sound of owls hooting, and similar sounds emulatingthe wildlife and fauna included in the selected theme, scene, orscenescape. Dynamic sounds may have a perceived characteristic of notbeing continuous.

The position of slide bar 402 within the second control region 491 maydefine the volume or sound power output level of the speakers and thefrequency of playback or density for the dynamic sounds that areincluded in the selected theme, scene, or scenescape. For example, ifthe slide bar 402 is positioned just to the right of line 430, thensteady-state sounds in the selected theme, scene, or scenescape may beplayed back at their frequency of repetition and volume or sound poweroutput when slide bar 402 reached the positon of line 430. The dynamicsounds in the selected theme, scene, or scenescape may be played back ata low frequency of repletion and a low volume or sound power output whenslide bar 402 is positioned just to the right of line 430.

If the slide bar 402 is moved to the right and stopped just before theslide bar reaches a position of vertical line 432, then steady-statesounds in the selected theme, scene, or scenescape may continue to beplayed back at their frequency of repetition and volume or sound poweroutput when slide bar 402 reached the positon of line 430. The dynamicsounds in the selected theme, scene, or scenescape may be played back ata higher frequency of repletion and a higher volume or sound poweroutput than when slide bar 402 is positioned just to the left of line430.

A third control region 492 for slide bar 402 begins at the vertical line432 and it ends at the right extent 424 of slide bar guide 422. Leader414 shows the range of third control region 492. In one example, whenslide bar 402 enters the third control region 492, the volume or soundpower output of steady-state sounds and dynamic sounds may be maintainedat their most recent levels and the stead-state and dynamic soundsfrequency of playback may be maintained at their most recent levels. Thecomputing system 109 shown in FIG. 1 or audio system 232 shown in FIG. 2may begin to play back sounds stored in non-volatile memory that areincluded in a third group of sounds that are associated with theselected particular theme, scene, or scenescape. The sounds may beplayed back or broadcast through the vehicle's speakers. The third groupof sounds may be characterized as surreal sound elements. Surreal soundelements may include but are not limited to the sound of coyoteshowling, the sound of elk bugling, the sound of thunder claps, and otherunnatural sounds intended to augment the user's emotional response tothe selected theme, scene, or scenescape.

The position of slide bar 402 within the third control region 492 maydefine the volume or sound power output level of the speakers and thefrequency of playback or density for the surreal sounds that areincluded in the selected theme, scene, or scenescape. For example, ifthe slide bar 402 is positioned just to the right of line 432, thensteady-state and dynamic sounds in the selected theme, scene, orscenescape may be played back at their frequency of repetition andvolume or sound power output when slide bar 402 reached the positon ofline 432. The surreal sounds in the selected theme, scene, or scenescapemay be played back at a low frequency of repletion and a low volume orsound power output when slide bar 402 is positioned just to the right ofline 432.

If the slide bar 402 is moved to the right and stopped just before theslide bar reaches the extent 424 of slide bar guide 422, thensteady-state and dynamic sounds in the selected theme, scene, orscenescape may continue to be played back at their frequency ofrepetition and volume or sound power output when slide bar 402 reachedthe positon of line 432. The surreal sounds in the selected theme,scene, or scenescape may be played back at a higher frequency ofrepletion and a higher volume or sound power output than when slide bar402 is positioned just to the right of line 432.

Thus, a sole activity control may be the basis for increasing acomplexity of sounds generated via computing system 109 shown in FIG. 1or audio system 232 shown in FIG. 2. Further, the volume and intensityof sound generated and broadcast through speakers may be adjusted viathe same activity control by defining control regions for the activitycontrol.

Referring now to FIG. 4C, an example where two activity controls areincluded in the system of FIGS. 1-3 is shown. Activity control 400 isthe same activity control that is shown in FIGS. 4A and 4B. Further,activity control 400 includes the same previously mentioned controlregions 490-492. Activity control 400 also includes the same slide bar402 and slide bar guide 422. Activity control 400 may operate andprovide the functionality previously described.

Second activity control 450 includes a slide bar 452 and a slide barguide 460. The slide bar 452 may be moved longitudinally left and rightalong slide bar guide 460 and between left extent 462 and right extent464 as indicated by arrows 454 via user 403. In this example, secondactivity control 450 has a control range or range of authority 475 thatis subdivided into two control regions 470 and 472, although range ofauthority 475 may be subdivided into additional control regions ifdesired. In one example, surround sound control parameters may beadjusted as a function of a position of slide bar 452 and the controlregion in which slide bar 452 is located. For example, when slide bar452 is positioned in first control region 470 a center spread may beincreased as slide bar 452 is moved from extent 462 toward vertical line499. Increasing the center spread may change sound distribution from acenter speaker to front left and right speakers. The center spread mayreach a maximum level when slide bar 452 reaches the position ofvertical line 499. If slide bar moves into second control region 472,then the level of up-mixed channels may be adjusted.

For example, the level of up-mixed channels may increase as slide bar452 moves from vertical line 499 to extent 464. Second activity control450 may also adjust other surround sound control parameters such as roomsize emulation, delay time, and dynamic compression. Further, secondactivity control 450 may adjust sound control parameters for vehiclespecific sound control parameters. For example, second activity control450 may adjust delivery of sounds to speakers to improve sound receptionfor a particular passenger (e.g., front driver, front passenger, etc.).

In an example, the second activity control 450 may adjust the locationof specific sound to different regions of the vehicle. For example, thesecond activity control may adjust the sound distribution and/orlocation within the various vehicle zones (e.g., front left passenger,front right passenger, etc.) differently for the different sound groupregions, such as steady-state sound elements, dynamic sound elements,and/or surreal sound elements. The user input controls may thus providefor adjustment of the vehicle zone to provide different control of eachof the different group regions in each of the vehicle zones. In anotherexample, the user input controls may provide for movement from oneregion to another of only one of the group regions, such as thesteady-state sound element.

Thus, activity controls may be assigned to adjust more than one soundcontrol parameter. Further, two or more activity controls may beprovided to further increase system flexibility and user experience. Inthis way, a single activity control may be assigned one or morefunctions to reduce a number of user inputs, thereby reducing systemcomplexity as perceived by a user.

The system of FIGS. 1-4C provides for a sound system of a vehicle,comprising: one or more speakers; and a controller electrically coupledto the one or more speakers including executable instructions stored innon-transitory memory that cause the controller to increase a frequencyof occurrence and audible level of a sound that is generated via the oneor more speakers according to a state of a user control. The systemincludes wherein the user control includes an operating range that issubdivided into a plurality of sound group regions, each of theplurality of sound group regions including one or more sounds unique toa sound group region with the plurality of sound group regions, andwherein the one or more speakers are included within a vehicle passengercabin. The system further comprises additional executable instructionsto generate sounds from only a first group of sounds included in a firstsound group region of the plurality of sound group regions when a usercontrol is positioned in the first sound group region. The systemfurther comprises additional executable instructions to generate soundsfrom only from the first group of sounds and a second group of soundsincluded in first and second sound group regions of the plurality ofsound group regions when the user control is positioned in the secondsound group region. The system further comprises additional executableinstructions to generate sounds from a first group of sounds, the secondgroup of sounds, and the third group of sounds when the user control ispositioned in the third sound group region. The system further comprisesadditional executable instructions to increase a sound level of soundsgenerated according to the position of the user control.

Referring now to FIG. 5, plots showing how audio attributes of soundsmay be modified according to a state of an activity control or userinterface changes are shown. The plots show how a computing system 109shown in FIG. 1 or an audio system 232 shown in FIG. 2 may adjust soundsaccording to the method of FIG. 6 and the system of FIGS. 1-4A.

The first plot from the top of FIG. 5 is a plot of sound output poweramplitude or volume versus activity control regions (e.g., 490-492). Thevertical axis represents the sound output power amplitude for soundsthat are included in a first group (e.g., steady-state sounds) of soundsthat are associated with a first control region of the activity control.The sound output power amplitude increases in the direction of thevertical axis arrow. The horizontal axis represents activity controlregions and it is broken into three regions as shown in FIG. 4B. Trace502 represents the sound output power amplitude or volume for soundsincluded in the first group of sounds.

The second plot from the top of FIG. 5 is a plot of sound frequency ofplayback (e.g., the frequency a sound is repeated when broadcast viaspeakers) for sounds that are included in the first group of soundsversus activity control regions. The vertical axis represents thefrequency of playback for sounds that are included in a first group ofsounds that are associated with a first control region of the activitycontrol. The horizontal axis represents activity control regions and itis broken into three regions as shown in FIG. 4B. Trace 504 representsthe sound frequency of playback for sounds included in the first groupof sounds.

The third plot from the top of FIG. 5 is a plot of sound output poweramplitude or volume versus activity control regions. The vertical axisrepresents the sound output power amplitude for sounds that are includedin a second group (e.g., dynamic sounds) of sounds that are associatedwith a second control region of the activity control. The sound outputpower amplitude increases in the direction of the vertical axis arrow.The horizontal axis represents activity control regions and it is brokeninto three regions as shown in FIG. 4B. Trace 506 represents the soundoutput power amplitude or volume for sounds included in the second groupof sounds.

The fourth plot from the top of FIG. 5 is a plot of sound frequency ofplayback for sounds that are included in the second group of soundsversus activity control regions. The vertical axis represents thefrequency of playback for sounds that are included in a second group ofsounds that are associated with a second control region of the activitycontrol. The horizontal axis represents activity control regions and itis broken into three regions as shown in FIG. 4B. Trace 508 representsthe sound frequency of playback for sounds included in the second groupof sounds.

The fifth plot from the top of FIG. 5 is a plot of sound output poweramplitude or volume versus activity control regions. The vertical axisrepresents the sound output power amplitude for sounds that are includedin a third group (e.g., surreal sounds) of sounds that are associatedwith a third control region of the activity control. The sound outputpower amplitude increases in the direction of the vertical axis arrow.The horizontal axis represents activity control regions and it is brokeninto three regions as shown in FIG. 4B. Trace 510 represents the soundoutput power amplitude or volume for sounds included in the third groupof sounds.

The sixth plot from the top of FIG. 5 is a plot of sound frequency ofplayback for sounds that are included in the third group of soundsversus activity control regions. The vertical axis represents thefrequency of playback for sounds that are included in a third group ofsounds that are associated with a third control region of the activitycontrol. The horizontal axis represents activity control regions and itis broken into three regions as shown in FIG. 4B. Trace 512 representsthe sound frequency of playback for sounds included in the third groupof sounds.

The seventh plot from the top of FIG. 5 is a plot of activity controlstate or position versus activity control regions. The vertical axisrepresents the state or position of the activity control (e.g., slidebar 402) and the activity control moves from left to right in thedirection of the vertical axis arrow. The horizontal axis representsactivity control regions and it is broken into three regions as shown inFIG. 4B. Trace 514 represents the activity control state or position.

At the left most side of the plots, the activity control is positionedat a first extent (e.g., 420 of FIG. 4) of the activity control. Theactivity control is in the first control region so the sound outputpower amplitudes or volumes and the sound frequency of playback forsounds that are included in the second and third groups of sounds arezero. The sound output power amplitude of sounds included in the firstgroup of sounds increases as the position of the activity control movesfrom the left side of the plot to the right side of the plot. Likewise,the frequency of playback or repetition for sounds that are included inthe first group of sounds increases as the activity control moves fromthe left side of the plot to the right side of the plot. The soundoutput power amplitude of sounds included in the first group of soundsceases increasing when the activity control reaches the position ofvertical line L1. Likewise, the frequency of playback or repetition forsounds that are included in the first group of sounds ceases increasingwhen the activity control reaches the position of vertical line L1.

Continuing to move from left to right in the plots, the sound outputpower amplitude and the frequency of playback for sounds included in thefirst group remain constant. The sound output power amplitude of soundsincluded in the second group of sounds increase as the position of theactivity control moves from the position of vertical line L1 to verticalline L2. Likewise, the frequency of playback or repetition for soundsincluded in the second group of sounds increase as the activity controlmoves from the position of vertical line L1 to vertical line L2. Thesound output power amplitude and the frequency of playback for soundsincluded in the third group remain zero. The sound output poweramplitude of sounds included in the second group of sounds ceasesincreasing when the activity control reaches the position of verticalline L2. Likewise, the frequency of playback or repetition for soundsthat are included in the second group of sounds ceases increasing whenthe activity control reaches the position of vertical line L2.

After the sound activity control reaches the position of line L2, thesound output power amplitude and the frequency of playback for soundsincluded in the first and second groups remain constant. The soundoutput power amplitude of sounds included in the third group of soundsincrease as the position of the activity control moves from the positionof vertical line L2 to the activity control extent (e.g., 424 of FIG.4A) or end of travel. Likewise, the frequency of playback or repetitionfor sounds that are included in the third group of sounds increase asthe activity control moves from the position of vertical line L2 to theactivity control extent (e.g., 424 of FIG. 4A) or end of travel.

In this way, sounds from different sound groups may be blended togetheras an activity control changes position or state. Further, the frequencyat which sounds are repeated may be increased or decreased as theposition of the activity control is changed. Thus, a diversity of soundsmay be generated via a single activity control to improve userexperience.

FIG. 6 shows a flow chart for an example method 600 for adjusting audiooutput (e.g., in a vehicle). Method 600 may be performed by a computingsystem 109 and/or combination of computing systems and audio systems,which may include one or more computing systems integrated in a vehicle.For example, method 600 may be performed by executing instructionsstored in memory of an in-vehicle computing system 109 alone or incombination with one or more other vehicle systems (e.g., audiocontrollers, CAN buses, engine controllers, etc.). The computing system109 may perform method 600 including adjusting actuators (e.g.,speakers) in the real world and perform operations internally thatultimately are a basis for adjusting actuators in the real world. One ormore steps included in method 600 may optionally be performed.

At 602, the method 600 displays one or more activity controls (e.g., 400shown in FIG. 4A) to a touch screen panel display. In one example, theone or more activity controls may take the form of a sound slider bar;however, in other examples, the activity control may take the form of adial, knob, or other known user input device. Method 600 proceeds to604.

At 604, method 600 receives data from a touch screen display todetermine if a user is touching the display to indicate a desired stateor position for the one or more sound activity controls. Method 600determines if a user is attempting to adjust a position of the soundactivity controls (e.g., slider bar 402 shown in FIG. 4A) and updatesthe position of the sound activity control if it is determined that theuser is attempting to adjust the position of the sound activity control.Method 600 proceeds to 606.

At 606, method 600 determines the state or position of the soundactivity control according to data received from the touch screendisplay or other user input device. Method 600 may also subdivide thecontrol range of the sound activity control into a plurality of controlregions as shown in FIG. 4B. For example, the control range of the soundactivity control may be subdivided based on the actual total number ofgroups of sound elements (e.g., a first group of sound elements may besteady-state sound elements; a second group of sound elements may bedynamic sound elements; a third group of sound elements may be surrealsound elements) and physical dimensions of the sound activity control.Thus, if there are three sound element groups, the range of the soundactivity control may be subdivided into three equal length controlregions as shown in FIG. 4B. In other examples, the control regions maybe a function of or based on surround sound control parameters or othersound control parameters. Method 600 may determine the state or positionof the sound activity control and in which region of control the soundactivity control is positioned according to data output via the touchpanel display or other device. Method 600 proceeds to 608.

At 608, method 600 determines a theme, scene, or scenescape viareceiving a selection from a user input device (e.g., a touch screendisplay). The theme, scene, or scenescape selections may include but arenot limited to a desert, rain forest, sea shore, etc. In addition, insome examples, two or more themes, scenes, or scenescapes may beselected so that sounds from different themes, scenes, or scenescapesmay be combined, if desired. Method 600 proceeds to 610.

At 610, method 600 determines sounds that are associated with theselected theme, scene, or scenescape. The sounds for the selected theme,scene, or scenescape may also be grouped. For example, a desert thememay include sounds of crickets included in a first group (e.g.,steady-state) of sounds that also includes sounds of a light desert windand/or sounds of a campfire. The desert theme may also include birdcalls in a second group (e.g., dynamic) of sounds that also includessounds of distant thunder. In addition, the desert theme may includecoyote howling in a third group (e.g., surreal) of sounds that alsoincludes sound of a distant train whistle. Thus, each theme, scene, orscenescape may be associated with one or more groups of sounds, and theone or more groups of sounds may be further differentiated by soundelement classification (e.g., steady-state, dynamic, and surreal). Thesounds may be retrieved from non-volatile memory when a theme, scene, orscenescape is selected. In addition, a visual representation of theselected theme, scene, or scenescape may be displayed via the in-vehiclecomputing system. Method 600 proceeds to 612.

At 612, method 600 judges if the sound activity control is positionedwithin a first control region according to output of a user inputdevice. If method 600 judges that the sound activity control is within afirst control region, the answer is yes and method 600 proceeds to 630.Otherwise, the answer is no and method 600 proceeds to 614.

At 614, method 600 judges if the sound activity control is positionedwithin a second control region according to output of a user inputdevice. If method 600 judges that the sound activity control is within asecond control region, the answer is yes and method 600 proceeds to 620.Otherwise, the answer is no and method 600 proceeds to 616.

It should be noted that although method 600 includes provisions forthree control regions, the actual total number of control regions may beincreased or decreased in a similar way. Additional sound elementcategories may be added by increasing the number of control regions.

At 630, method 600 ceases playing back or broadcasting sounds from thesecond and third groups of sound elements. Further, method 600 adjusts asound output power of sounds that are included in the second and thirdgroups of sound elements to zero. Method 600 also adjusts the frequencyof playback or repetition of sounds that are included in the second andthird groups of sound elements to a base rate (e.g., a slowest frequencythat the sounds may be played back or broadcast via speakers). Thus, ifthe sound activity control is moved from a second control region to afirst control region as may occur by moving slider bar 402 of FIG. 4Bfrom right to left, sounds included in the second and third groups ofsound elements are not played back or broadcast via speakers. Method 600proceeds to 632.

At 632, method 600 plays (e.g., broadcasts via speakers) and adjustsvolume or sound output power amplitudes and frequency of playback orrepetition of sounds that are included in the first group of soundelements (e.g., steady-state sounds) associated with the selected theme,scene, or scenescape. The sound output power amplitude may be adjustedproportionately with a position of the activity control while theactivity control is position within the first control region. Forexample, if the activity control is moved from left to right, the soundpower amplitude or volume may increase proportionately with theadjustment of the activity control. Likewise, the frequency of playbackor repetition of sounds that are included in the first group of soundsmay be adjusted proportionately with the position of the activitycontrol while the activity control is positioned within the firstcontrol region. For example, if the activity control is moved from leftto right, repetition of a recording of sounds may increaseproportionately with the adjustment of the activity control. One exampleof controlling sounds of a first group of sounds in this way is shown inthe first and second plots from the top of FIG. 5 between the verticalaxis and vertical line L1.

It should also be mentioned that the activity control may be configuredto make other sound and/or sound system adjustments according to thecontrol regions of the activity control beyond volume and frequency ofrepetition adjustments. For example, instead of adjusting the soundoutput power amplitude and frequency of repetition for sounds of a firstgroup of sounds that are associated with the selected theme, scene, orscenescape, the sounds of the first group of sounds may be adjusted inother ways, including but not limited to adjusting the sounds accordingto surround sound up-mixer tuning parameters, delay time, reverberation,recreated or emulated sound venues (e.g., hall, stadium, theater, etc.),simulated distance to source of sound, and zonal sound control locationswithin a vehicle passenger cabin. As one example, adjusting the activitycontrol position may move vehicle occupant's sound perception oflistening to crickets chirp in the distance to listening right next tochirping crickets. In addition, where two or more activity controls areimplemented or realized at once in the vehicle or by the in-vehiclecomputing system 109, one activity control may adjust sounds beingplayed back, volume of sounds being played back, and frequency orrepetition of sounds being played back. The other activity control mayadjust surround sound up-mixer tuning parameters and zonal sound controlwithin a vehicle. Method 600 proceeds to exit.

At 612, method 600 maintains playing sounds in the first group and inthe second group at their present sound output power levels. Method 600also maintains repetition rates of sounds in the first and second groupsat their present frequency or rate. Thus, if the sound activity controlis moved from a second control region to a third control region as mayoccur by moving slider bar 402 of FIG. 4B from right to left, soundsincluded in the first and second groups continue to be played back orbroadcast via speakers as they were just before entering the thirdcontrol region. Method 600 proceeds to 614.

At 614, method 600 adjusts volume or sound output power amplitudes andfrequency of playback or repetition of sounds that are included in thethird group of sound elements (e.g., surreal sounds) associated with theselected theme, scene, or scenescape. The sound output power amplitudemay be adjusted proportionately with a position of the activity controlwhile the activity control is position within the third control region.Likewise, the frequency of playback or repetition of sounds that areincluded in the third group of sounds may be adjusted proportionatelywith the position of the activity control while the activity control ispositioned within the third control region.

One example of controlling sounds of a third group of sounds in this wayis shown in the fifth and sixth plots from the top of FIG. 5 betweenvertical line L2 and the right limit of the plots. As previouslymentioned, the activity control may be configured to make other soundand/or sound system adjustments according to the control regions of theactivity control beyond volume and frequency of repetition adjustments.As one example, adjusting the activity control may move vehicleoccupant's sound perception of listening to a coyote howling in thedistance to listening right next to a howling coyote. In addition, wheretwo or more activity controls are implemented or realized at once in thevehicle or by the in-vehicle computing system 109, one activity controlmay adjust sounds being played back, volume of sounds being played back,and frequency or repetition of sounds being played back. The otheractivity control may adjust surround sound up-mixer tuning parametersand zonal sound control within a vehicle. Method 600 proceeds to exit.

At 620, method 600 ceases playing back sounds that belong to the thirdgroup of sounds and maintains playing sounds in the first group and inthe second group at their present sound output power levels. Method 600also maintains repetition rates of sounds in the first group at theirpresent frequency or rate. Thus, if the sound activity control is movedfrom a first control region to a second control region, or from a thirdcontrol region to the second control region, sounds included in thefirst group of sounds continue to be played back or broadcast viaspeakers as they were just before entering the second control region.Method 600 proceeds to 622.

At 622, method 600 adjusts volume or sound output power amplitudes andfrequency of playback or repetition of sounds that are included in thesecond group of sound elements (e.g., dynamic sounds) associated withthe selected theme, scene, or scenescape. The sound output poweramplitude may be adjusted proportionately with a position of theactivity control while the activity control is position within thesecond control region. Likewise, the frequency of playback or repetitionof sounds that are included in the second group of sounds may beadjusted proportionately with the position of the activity control whilethe activity control is positioned within the second control region. Oneexample of controlling sounds of a second group of sounds in this way isshown in the third and four plots from the top of FIG. 5 betweenvertical line L1 and vertical line L2.

As previously mentioned, the activity control may be configured to makeother sound and/or sound system adjustments according to the controlregions of the activity control beyond volume and frequency ofrepetition adjustments. As one example, adjusting the activity controlmay move vehicle occupant's sound perception of listening to a birdcalling in the distance to listening right next to a bird that iscalling. In addition, where two or more activity controls areimplemented or realized at once in the vehicle or by the in-vehiclecomputing system 109, one activity control may adjust sounds beingplayed back, volume of sounds being played back, and frequency orrepetition of sounds being played back. The other activity control mayadjust surround sound up-mixer tuning parameters and zonal sound controlwithin a vehicle. Method 600 proceeds to exit.

In this way, an activity control may be used to adjust sounds and soundcontrols for sounds that may be associated with a theme, scene, orscenescape. The activity control provides a simplified way of creating apersonalized environment within a vehicle or other listening venue.

Thus, the method of FIG. 6 provides for a method for generating soundsin a vehicle, comprising: generating sounds according to a state of auser control that includes an operating range that is subdivided into aplurality of group regions, each of the plurality of group regionsassociated with one or more elements unique to a group region within theplurality of group regions. The method includes wherein generatingsounds includes converting electrical signals into sounds via one ormore speakers, wherein the plurality of regions are sound group regions,wherein the elements are sounds. The method includes wherein a firstgroup of the plurality of sound group regions is a group steady-statesound elements. The method includes wherein a second group of theplurality of sound group regions is a group dynamic sound elements. Themethod includes wherein a third group of the plurality of sound groupregions is a group surreal sound elements. The method further comprisesincreasing an actual total number of sounds generated according to theposition of the user control in the plurality of group regions. Themethod further comprises increasing an actual total number of soundsgenerated according to the position of the user control in one of theplurality of group regions. The method includes wherein the one or moreelements include surround sound control parameters, and furthercomprising: increasing a sound level according to the position of theuser control in the plurality of group regions.

The method of FIG. 6 also includes a method for generating sounds in avehicle, comprising: increasing a frequency of a sound generated and anaudible sound level of the sound generated in response to a state of asingle user control input device, the sound generated from a group ofsounds stored in controller memory. The method includes where the soundgenerated is included in a first group of sounds corresponding to afirst region of an operating range of a user control. The method furthercomprises adjusting a frequency of a second sound generated and anaudible sound level of the second sound generated in response to theposition of the single user control input device when the single usercontrol input device is in a second region of the operating range of theuser control, the second sound generated from the group of sounds storedin controller memory. The method further comprises increasing afrequency of a third sound generated and an audible sound level of thethird sound generated in response to the position of the single usercontrol input device when the single user control input device is in athird region of the operating range of the user control, the third soundgenerated from the group of sounds stored in controller memory. Themethod further comprises not adjusting the frequency of the second soundgenerated in response to the single user control input not being in thesecond region of the operating range. The method further comprises notadjusting the frequency of the third sound generated in response to thesingle user control input not being in the third region of the operatingrange.

Referring now to FIG. 7, example scenes and their associated sound filesare shown. FIG. 7 shows two example scenes and associated sound filesthat may be made available to a user to enhance a user's experiencewhile traveling in a vehicle.

An example, desert scene 700 is shown. A user may wish to experience thesounds of a desert landscape. The user may select a desert scene and apicture or rendering of a desert may be shown on an in vehicle displayscreen as shown in FIG. 1 at 111. The desert scene may include aplurality of associated sound files 702-706 that are stored incontroller non-volatile memory. The associated sound files may begrouped together according to the type of sounds or the way the soundsare applied via the in-vehicle computing system 109 or audio system 232.In this example, a first group of sounds 702 may be referred to assteady-state elements or sounds. The steady-state sounds in this exampleare sounds of crickets and sounds of a campfire. A second group ofsounds 704 may be referred to as dynamic elements or sounds. The dynamicsounds in this example are sounds of owl hoots and sounds of bird calls.A third group of sounds may be referred to as surreal elements orsounds. The surreal sounds in this example are sounds of distant thunderand sounds of a coyote howling. Of course, the sound groups may bereferred to in ways other than steady-state, dynamic, and surreal, ifdesired. The sound files may be played back or broadcast via speakers asdescribed in the method of FIG. 6.

An example, ocean scene 750 is also shown. A user may wish to experiencethe sounds of an ocean front beach. The user may select an ocean sceneand a picture or rendering of the ocean may be shown on an in vehicledisplay screen. The ocean scene may include a plurality of associatedsound files 752-756 that are stored in controller non-volatile memory.The associated sound files may be grouped together as previouslydescribed. In this example, a first group of sounds 752 may be referredto as steady-state elements or sounds. The steady-state sounds in thisexample are sounds of waves and sounds of wind. A second group of sounds754 may be referred to as dynamic elements or sounds. The dynamic soundsin this example are sounds of fish surfacing and birds calling. A thirdgroup of sounds may be referred to as surreal elements or sounds. Thesurreal sounds in this example are sounds of fog horns and ship horns.The sound files may be played back or broadcast via speakers asdescribed in the method of FIG. 6.

The approach herein may utilize the above-described in-car tuning,mixing, and reproduction process to enable user-control of a variety ofnature sounds. In one example, the process includes utilizing referencerecording, such as with the three components described herein, sounddesign reproduction, and in-car up-mixing and dynamic routing. As noted,in one example, at least some of the reference recording data isobtained from the actual scene, where sound engineers travel to thelocation and capture spatially accurate audio/video field recordings,and capture the intended “emotional affect” of the scene. Additionally,local fauna, flora, and wildlife species must be noted for the laterstages of the process.

For sound design reproduction—due to technical constraints of typicalfield recording equipment, the original field recordings may bereproduced from clean, representative audio samples. In some examples,the field recording might contain the sound of an owl hooting in thebackground, but these may also contain wind noise, ambient noise, and ingeneral a high noise floor, rendering them less suitable for a criticallistening environment like a premium branded audio vehicle. These soundsmay then be reproduced from a sample library, gathered from cleanerclose-mic recordings, or synthesized in some other manner.

Next, with regard to the in-car up-mixing and dynamic routing—the sliderbars noted above herein may be used to enable the in-car mixing process.The reproduced samples may be injected into the vehicle signal pathdownstream of the surround sound upmixer (QLI) and upstream of thevehicle channel tuning parameters. This allows flexible, spatial controlover the placement of these sounds. Typically may yield three types ofsound elements as noted herein: steady-state base elements, dynamicelements, and surreal elements. These three types of elements can thenme mixed in the vehicle to recreate a spatially accurate nature-scapethat captures the spectral content of the space, as well as the spatialcharacteristics and the overall emotional affect as well.

In this way, it is possible to address the technical challenge ofcreating spatially accurate soundscapes in a vehicle of a wide varietywith reduced storage and selection requirements. Likewise, it addressthe technical challenge of providing some tuning capabilities andflexibility, including a high level of flexibility in the spatial mixingprocess, which yields a more accurate NatureScapes experience in thecar.

The description of embodiments has been presented for purposes ofillustration and description. Suitable modifications and variations tothe embodiments may be performed in light of the above description ormay be acquired from practicing the methods. The methods may beperformed by executing stored instructions with one or more logicdevices (e.g., processors) in combination with one or more additionalhardware elements, such as storage devices, memory, image sensors/lenssystems, light sensors, hardware network interfaces/antennas, switches,actuators, clock circuits, etc. The described methods and associatedactions may also be performed in various orders in addition to the orderdescribed in this application, in parallel, and/or simultaneously.Further, the described methods may be repeatedly performed. Thedescribed systems are exemplary in nature, and may include additionalelements and/or omit elements. The subject matter of the presentdisclosure includes all novel and non-obvious combinations andsub-combinations of the various systems and configurations, and otherfeatures, functions, and/or properties disclosed.

As used in this application, an element or step recited in the singularand proceeded with the word “a” or “an” should be understood as notexcluding plural of said elements or steps, unless such exclusion isstated. Furthermore, references to “one embodiment” or “one example” ofthe present disclosure are not intended to be interpreted as excludingthe existence of additional embodiments that also incorporate therecited features. The terms “first,” “second,” and “third,” etc. areused merely as labels, and are not intended to impose numericalrequirements or a particular positional order on their objects. Thefollowing claims particularly point out subject matter from the abovedisclosure that is regarded as novel and non-obvious.

1. A method for generating sounds in a vehicle, comprising: generatingsounds according to a state of a user control that includes an operatingrange that is subdivided into a plurality of group regions, each of theplurality of group regions associated with one or more elements uniqueto a group region within the plurality of group regions.
 2. The methodof claim 1, wherein generating sounds includes converting electricalsignals into sounds via one or more speakers, wherein the plurality ofregions are sound group regions, wherein the elements are sounds.
 3. Themethod of claim 1, wherein a first group of the plurality of sound groupregions is a group steady-state sound elements.
 4. The method of claim3, wherein a second group of the plurality of sound group regions is agroup dynamic sound elements.
 5. The method of claim 1, wherein a thirdgroup of the plurality of sound group regions is a group surreal soundelements.
 6. The method of claim 1, further comprising increasing anactual total number of sounds generated according to the position of theuser control in the plurality of group regions.
 7. The method of claim1, further comprising increasing an actual total number of soundsgenerated according to the position of the user control in one of theplurality of group regions.
 8. The method of claim 1, wherein the one ormore elements include surround sound control parameters, and furthercomprising: increasing a sound level according to the position of theuser control in the plurality of group regions.
 9. A sound system of avehicle, comprising: one or more speakers; and a controller electricallycoupled to the one or more speakers including executable instructionsstored in non-transitory memory that cause the controller to increase afrequency of occurrence and audible level of a sound that is generatedvia the one or more speakers according to a state of a user control. 10.The system of claim 9, wherein the user control includes an operatingrange that is subdivided into a plurality of sound group regions, eachof the plurality of sound group regions including one or more soundsunique to a sound group region with the plurality of sound groupregions, and wherein the one or more speakers are included within avehicle passenger cabin.
 11. The system of claim 10, further comprisingadditional executable instructions to generate sounds from only a firstgroup of sounds included in a first sound group region of the pluralityof sound group regions when a user control is positioned in the firstsound group region.
 12. The system of claim 11, further comprisingadditional executable instructions to generate sounds from only from thefirst group of sounds and a second group of sounds included in first andsecond sound group regions of the plurality of sound group regions whenthe user control is positioned in the second sound group region.
 13. Thesystem of claim 12, further comprising additional executableinstructions to generate sounds from a first group of sounds, the secondgroup of sounds, and the third group of sounds when the user control ispositioned in the third sound group region.
 14. The system of clam 13,further comprising additional executable instructions to increase asound level of sounds generated according to the position of the usercontrol.
 15. A method for generating sounds in a vehicle, comprising:increasing a frequency of a sound generated and an audible sound levelof the sound generated in response to a state of a single user controlinput device, the sound generated from a group of sounds stored incontroller memory.
 16. The method of claim 15, where the sound generatedis included in a first group of sounds corresponding to a first regionof an operating range of a user control.
 17. The method of claim 15,further comprising adjusting a frequency of a second sound generated andan audible sound level of the second sound generated in response to theposition of the single user control input device when the single usercontrol input device is in a second region of the operating range of theuser control, the second sound generated from the group of sounds storedin controller memory.
 18. The method of claim 17, further comprisingincreasing a frequency of a third sound generated and an audible soundlevel of the third sound generated in response to the position of thesingle user control input device when the single user control inputdevice is in a third region of the operating range of the user control,the third sound generated from the group of sounds stored in controllermemory.
 19. The method of claim 18, further comprising not adjusting thefrequency of the second sound generated in response to the single usercontrol input not being in the second region of the operating range. 20.The method of claim 19, further comprising not adjusting the frequencyof the third sound generated in response to the single user controlinput not being in the third region of the operating range.